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1.  Background 


-  C2  systems  are  adaptive  control  systems 

-  Traditionally  control  over  selected  aspects  of 
battle  environments 

-  NCW  creates  an  integrated  system 

-  NCW  hypothesis: 

■  C2  system  performances  are  enhanced  by  information 
technology  and  pervasive  networking  infrastructures 

■  Drastic  improvement  in  overall  force  effectiveness 

-  MoMs  to  test  the  hypothesis  and  compare 
alternative  C2  systems 

-  Aggregate  MoMs  at  each  node  and  over  the 
network 


2.1  MoM  Framework  -  MORS 


Four- level 
hierarchy  of 
measures  (1986) 

Adopted  by  NATO 
Code  of  Best 
Practice  for  C2 
Assessment  (2002) 

One  additional 
level  added  to 
account  for  OOTW 

Generic 


MoP  dp  MoE 


Element 


2.3  MoM  Framework  -  Knowledge  Analysis  Framework 


Focus  on  Human 
Performance  and 
roles  and  HMI's 


Measure  achieved 
performance  in 
successive  layers  to 
->  effectiveness  of 
transitions  between 
layers 

HOW  WELL  ARE  WE  DOING? 


Decision  superiority 

C2  comms  cdu 


Knowledge  superiority 


INSIGHT: Role  of  C4ISR 
systems  is  to  enable 
transitions  between  layers 

Measure  or 
dictate  C4ISR 
performance 

within  each 
transition 


KAF  draws  explicit  relationship  between  performance 
metrics  of  C4ISR  systems  and  military  effectiveness 


3.1  MoM 


-  A  generic  term  that  refers  to  the  metrics  by  which 
systems  are  measured,  assessed  and  compared 

-  Measurability 

■  Quantitative  (usually  physical  domain,  objective)  or 
qualitative  (usually  cognitive  domain,  subjective) 

■  Measurement  unit/scale 

■  Direction  of  improvement  (the  more  the  better,  the  less 
the  better,  target  is  best) 

-  Three  types  of  measures 

■  Rank  or  ordinal 

■  Relative  value 

■  Absolute  value 


ywi 


3.2  Are  C2  MoMs  in  NCW  context  different? 


-  “Identify  and  measure  key  features  of  NCW  and  relate 
these  characteristics  to  the  measurement  hierarchy” 

-  Basic  functions  of  C2  will  not  change 


-  Some  key  features  of  NCW 


Linking  of  battlespace  entities  with  the  transport  of  information 

Wide  application  of  information  technologies 

Emphasis  on  shared  awareness 

Information  enabled  organisations 

Self-synchronisation 


-  MoMs  that  can  assess  the  impact  of  NCW  features  on 
basic  C2  functions  and  mission  objectives 


-  Establish  causal  links 
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3.3  Examples  of  C2  MoMs  in  NCW  Context 

■  Node  connectivity 

■  Degree  of  transparent  information  sharing 

■  Percentage  of  right  information  provided  to  the  right 
node  at  the  right  time 

■  Effectiveness  of  battlespace  visualisation  system 


Consistency  of  situation  assessments 

Percentage  of  time  when  planners  can  conduct 
distributed/virtual  planning 

Availability  and  utility  of  decision  support  tools 

Degree  to  which  specific  effects  are  synchronised  over 
time,  geography  and  emergent  events 

Ability  to  apply  right  effects  on  the  right  targets 


4.1  Aggregation  of  MoMs  (1) 

-  ADF  effectiveness:  function  of  scenarios  and 
missions 


■  Versatility,  vulnerability,  survivability,  adaptability 


-  Aggregation  can  happen  at  all  levels  (except  the 
bottom  one)  of  the  measurement  hierarchy 

-  Multi-Criteria  Decision-Making  (MCDM) 


Direct  aggregation  methods:  SAW,  MEW,  utility  function 

Pair-wise  comparison  methods:  AHP,  CA 

Comparison-with-ideal  methods:  TOPSIS 

Outranking  methods:  ELECTRE,  PROMETHEE,  ORESTE 

Programming  methods:  DEA 

Fuzzy  logic  methods 

Probabilistic  methods 


4.1  Aggregation  of  MoMs  (2) 

-  Constrained  optimisation 

■  Objective  function:  linear  or  nonlinear  combination  of  MoMs 

■  System/state  equations:  relationships  of  MoMs 

■  Definitions/aggregations 

■  Constraints 

-  Statistical  Modelling 


■  Structural  equation  model  (SEM) 

■  Impact/structural  coefficients  among  same  level  of  MoMs 

■  Impact/structural  coefficients  between  an  MoM  and  its 
component  MoMs  or  the  weights  for  aggregation 

■  Various  reliability  measures 


-  Web  based  repository  of  C2  MoMs  and  data 

•  To  enable  re-usability/exploitability  of  existing  MoMs  and  data 


4.2  The  Repository’s  NCW  Indicators 


-  NCW  intensity  coefficient 

The  ratio  of  the  number  of  NCW-related  indicators  to  the 
total  number  of  MoMs 


-  NCW  power  coefficient 

The  ratio  of  the  sum  of  NCW-related  indicators'  ratings  to 
the  sum  of  all  MoMs’  ratings 


-  Genuinely  network  centric  MoMs 


Explicitly  exploits  the  underlying  network  structure 

Based  on  classical  network  optimisation  techniques  and 
graph  theory 

Can  be  optimised  with  respect  to  both  the  network 
structure  and  any  additional  constraints  that  may  be 
relevant  to  the  measure 
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4.3  Network  Flow  Optimisation  Problem 

-  A  given  network  of  fixed  capacity  N=<N,A,u> 

■  N  is  a  finite  set  of  nodes 

■  A  <z  {(/',  j)  |  i,  j  e  N }  is  the  set  of  arcs 

■  u  is  a  vector  of  capacities  u(,for  all  (i,j)  e  A  and  assuming  u„>0 

■  Flow  on  Wis  a  vector  x  whose  coordinates  x„  for  (i,  j)  e  A  satisfy 

0<x(J  <  u(J;  (i,  j)  eA 

-  Classical  network  flow  optimisation  problem 

■  Coefficient  matrix  A  captures  constraints  on  the  flow 

■  A  linear  objective  function  with  predefined  coefficient  matrix  c 

Max  cTx 

Subject  to:  Ax  =  b 

x  <  u  ( Nf ) 

x>  0 


4.4  Formulating  a  genuinely  NCW  MoM 


For  a  particular  MoM,  the  flow  xy  on  an  arc  (i,  j)  e  A  can  be 

■  A  possible  value  of  the  MoM  associated  with  the  arc,  or 

■  The  “weight”  associated  with  (i,  j)  for  that  MoM 

Suppose  x°  and  z°  ;=  cTx°  are  an  optimal  solution  of  (  Nf) 
We  can  define  genuinely  network  centric  MoM  as 

■  z°=  maxcTx°,  or 

■  Z ,)  e  ;,x0..  MoM  „  where  MoM^  is  the  part  associated  with  arc  (i,  j) 

The  virtue  is  that  the  underlying  graph  theoretic  structure 
of  w  is  incorporated  in  the  definitions 


-  There  are  other  researchers  investigating  mathematical 
metrics,  eg.  Perry  and  Bowden’s  work 


5.1  A  MOLE  scenario 


5.2  Constructing  Node  Connectivity  MoM 


-  Definitions 


■  Simple  connectivity/ 

and 

■  Criticality  of  connections  C,  where  c„  is  determined  by 
information  exchange  requirements  between  nodes 

■  Costs  4,  where  A I}  depends  on  the  actual  type  of 
communication  systems  used  to  provide  the  connection 


IX =° 


-  The  optimisation  problem  with  a  cost  limit  of  b 

■  Max 

■  Subject  to  >  . .  a,,x  ..  <  b  and 


c  x 

ij )  V  V 

) 

s,„ 

~C> 

VI 

H 

There  exists  a  path  from  every  i  to  every  j. 


-  The  optimised  node  connectivity 

The  optimal  value  of  the  objective  function 


C-X° 
V  V 
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5.3  Comments  about  aggregation  of  higher  level  MoMs 


NCW  C2  issues  are  usually  complex  and  poorly  defined 

The  elusive  and  intangible  nature  of  the  problem  presents 
real  challenges  for  modelling  relationships  among  MoMs 

Additive  aggregation  (especially  at  a  higher  level)  is  a 
rudimentary  first  order  approximation 

Does  not  capture  non-linearity,  or  sometimes  chaos, 
resulting  from  dynamic  interactions  of  composing  MoMs 

Used  properly  can  indicate  rough  tendencies  of  linear 
aspects,  but  can  be  swamped  by  non-linear  aspects 

Can  be  used  as  a  diagnostic  tool  to  focus  more  detailed 
analysis  or  experimentation 


5.4  Modelling  Situation  Assessment  MoM 


-  Definitions 


■  Individual  node  situation  assessment  S,  (average  over  time) 

■  In  the  context  of  situation  assessment,  criticality  of  cooperation  C,  where  c,; 
is  determined  by  the  need  of  cooperation  between  nodes  (a  very  crude 
approximation) 

■  Cooperation  coefficients  X,  where  x,;  describes  the  level  of  cooperation 
between  nodes  /  and  j 

■  u,y  determined  by  communication  links,  is  the  maximum  possible  value  of 
-  Processing  power  P,  where  p,  depends  on  the  nature  of  the  node 


-  The  optimisation  problem 


Max 


X 


C  X  ■ 
( U )  V  V 


Subject  to  Xo)x<;^A 


and 


X,-  < 


-  The  resulting  situation  assessment  V. 


where 


-  To  what  degree  this  indicator  represents  situation  assessment? 


6.  Conclusions 


NCW  infiltration  into  the  thinking  of  C2  MoMs 

Reviewed  existing  MoM  frameworks 

Adjustment  of  C2  MoMs  in  the  NCW  context 

Discussed  concepts  of  NCW-intensity  and  NCW- 
power  to  make  a  MoMs  repository  progressively 
more  network  centric 

Some  quantitative  techniques  for  hierarchical 
aggregation  of  MoMs 

Indication  of  how  genuinely  network  centric  MoM 
could  be  constructed 

An  example  in  MOLE 

A  lot  more  work  need  to  be  done  in  this  area 


